source 
program 




■ V 

compiler 




1 



ISA format 
binary or 
macrocode 



i4 



4 




i 



i+n 

i+n+1 
i+n+2 

i+n+3 
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1 A' 






c 


0' 
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To co-processor/ 
accelerator unit 



global trace 




stream indexed Local 
trace 0 



stream indexed 
Local trace 
N-1 



Global 
Dictionary 



Global dictionary 




Hot or high confidence blocks 



Pruned CFG 




Dynamic stream 
chains 




include fall-through block in current stream 



Yes 



terminate current stream and lookup dictionary for matching entry 



create a new stream entry in the 
table 



No 




Yes 








Stream Identifier 


Start ip 


End ip 


Coverage/ 
Frequency 


#predicate true 


#ld 












































































































































. - - . 








select hot streams eg. rank global stream dictionary based on 

coverage or other metric 



for each hot stream scan stream trace to find high^nfidence 

children 




get next stream B 



create an entry in 
children list for A 




No 



I 



i 



L1 

instruction cache 




branch 
predictor 



stream predictor 



register file 



049 



L1 

data cache 



L2 cache 



L3 cache 



memory 



2 



stream Dictionary 




start ip 


end ip 


ip for next stream 


A 


A+8 


.... ^ 


A 


A+16 




B 


B+24 



























































Stream Dictionary 




^\BX\ ip 


end ip 


ip for next steam 1 


ip for next stream 2 


























































: r-T 
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intitialize stream size to zero 



35^ 



retire instruction at instruction pointer 



I 



35+ 



increment stream size 



NO 




3^ 



YES 



NO 



L 





NO 



Z 



3^. 



create or replace entryfor 
new stream starting at 
branch target 



YES 



37 o 



decrease confidence for the matching 
entry 



/ 



increase confidence and statistics for entry 






use branch target ip as current stream 
starting ip 

1 






reset stream 


size to zero 



I 



start a new stream wiUi same start ip as 
matched stream 



37A 




STREAM PREDICTOR TABLE 



INPUT STREAMmLOCK 


TARGET STREAM«LOCK 


stream/normal 


confidence 


Start ip 


. 

end ip 


start ip 


end ip 




.. 




■ - 
















■ 



























































































































